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J a computation device, the computation device providing a subject score based 



on a 



\ ^c^/mt 

item-dependent operating characteristic of the speech recognition system, including the 
associated accuracy Vf the speech recognition system 



mbination of item scores using a scoring computation model that depends; upon an expected 
\ 




8. (Amended) A method for measuring an ability of a subject, comprising; 

providing^ set of task items; 

generating ^ifficulty value for each task item in the set, the difficulty value being based 

upon the task item arid a performance measurement associated with an automatic device that 

measures task performance, wherein the performance measurement comprises a measure of an 

ability of the automatic dfevice to accurately recognize responses to the set of tasks; 

obtaining a respond to each task item from the subject; and 
\ 

combining the difficulty values and the responses from the subject to form a subject score 
reflecting at least one of a linguistic ability and one cognitive ability of the subject. 




14^ Amended) A method for measuring an ability of a subject comprising: 
Hp/ providing a set of tasks and a device that automatically measures performance of the 
tasks; 

determining a difficulty value for each task, wherein the difficulty value is based upon the 
task and upon a performance measure associated with an ability of the automated device to 
accurately assess performance of the task; 



obtaining verbid responses to the tasks from the subject; and 
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combining the verbal responses and the difficulty values to form a subject score reflecting 
at least one of a linguistic ability and a cognitive ability of the subject 




16\ (Amended) An apparatus for determining a difficulty value of items in a test, 

compris 

a set &f responses to the items from a number of individuals; 

an automated grader, wherein the automatic grades receives the set of responses and 
provides graded responses; and 

means for reducing the graded responses to a set of item difficulties* said item difficulties 
normalizing the i\ems by reflecting an ability of the automatic grader to accurately grade the set 
of responses. 



17. (Amended) A method for determining a difficulty value of items in a text, 
comprising! 

obtaining a set of responses to the items from a number of individuals; 
automatically grading the set of responses, thereby generating graded responses; and 
reducing the graded responses to a set of item difficulties, said item difficulties including 

a measurement of accuracy for the act of automatically grading the set of responses for purposes 

of normalizing the items to provide an accurate assessment. 
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